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DATA COMPRESSION UNIT CONTROL FOR ALIGNMENT 
OF OUTPUT SIGNAL 

This invention relates to data connpression and especially to the compression of 
digital television signals. 

The example will be taken of the well-known MPEG-2 compression scheme. In 
5 television production, distribution and transmission, there are a variety of operations 
which require to be performed on MPEG-2 transport streams without adversely 
affecting the performance of - for example - downstream MPEG-2 decoders. The 
Q term 'transport stream" is used here to include both single-programme transport 
£ streams (TS) which comprise elementary streams of - for example - video, audio and 
10 data, and multi-programme transport streams (MPTS) which comprise two or more 
Tfi single-programme transports streams and - optionally — data or other services. 

A frequent requirement is to receive a nationally distributed MPTS and to 
p replace one of the programmes with a locally produced programme. Similarly, it is 
^ frequently required to insert local advertisements or announce programmes. A 
lil procedure exists for performing these types of operations, but the procedure is 
r: cumbersome and lacks flexibility. Briefly, the programme to be replaced within the 
nationally distributed SPTS is constructed so as to have within it a number of splice 
points. At these splice points, the group of picture (GOP) structure, the video buffering 
verifier delay and certain other parameters are constrained. Specifically, the GOP 
20 structure will be arranged so that the last picture (in presentation order) before an out 
point is either a non-predicted l-frame or a forward only predicted P-frame. The video 
buffering verifier delay (which corresponds with the buffer occupancy in the 
downstream decoder) will take a predefined value. The bitstream which is to be 
inserted at the splice point will then be arranged to start with an l-frame and to have an 
25 initial value for the video buffering verifier delay which is equal to the same 

predetermined value. This is cumbersome; moreover, it Is generally not possible to 
switch the bit-stream at anywhere other than the splice points. 

It is one object of the present invention to provide improved method and 
apparatus which overcomes or ameliorates the difficulties associated with prior art 
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techniques. 

Accordingly, the present invention consists in one aspect in a method of 
controlling a connpression unit which outputs a compressed bit-stream, the method 
comprising the steps of supplying to a reference input of the compression unit, a 
5 transport stream input with a sequence of transport packets; nominating a set of the 
transport packets as reference packets and arranging for the compression unit to 
output packets in alignment with the reference packets. 

Suitably, the transport stream comprises a multi-programme transport stream 
and wherein the nominated set of transport packets comprises those packets 
5o associated with a selected programme. The nominated set of transport packets will 
S3 typically comprise sub-sets of packets, those sub-sets being associated with respective 
m video, audio, data and sen/ice information elementary streams of the selected 
programme. 

J" Advantageously, each compression unit is arranged to output packets having at 

^fs least one parameter determined by the reference packet with which it is in alignment. 
O Those parameters may include: a clock reference such as the MPEG-2 Programme 
Q Clock Reference (PGR); the location of video and audio frame starts; time stamps 
^ such as the MPEG-2 Presentation Time Stamps (PTS) and Decode Time Stamps 
(DTS); and a delay value such as the MPEG-2 Video Buffering Verifier (VBV) delay. 

20 In a different aspect, the present invention consists in a method of replacing a 

programme within a multi-programme transport stream by the output of a programme 
compression unit, comprising the steps of supplying the multi-programme transport 
stream to a reference input of the compression unit, nominating as reference packets 
those packets which are associated with the programme to be replaced; arranging for 

25 the compression unit to output packets in alignment with the reference packets; and re- 
multiplexing the output of a programme compression unit with the remaining packets of 
the multi-programme transport stream. 

In one arrangement according to this invention, there is proposed the use of a 
"reference" MPEG-2 bit-stream input to an MPEG-2 encoder, such that the output of 
30 the encoder is controlled by this "reference" input. This input is in addition to and in 
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parallel with the other customary inputs to an encoder. 

The "reference" MPEG-2 bit-stream input could be regarded as the MPEG-2 
equivalent of the "genlock" synchronisation input common on equipment handling 
uncompressed video. The latter input is used to force the equipment's output to 
conform with the timing of one particular video signal, whereas the "reference" 

MPEG-2 bit-stream input is used to force the output of the MPEG-2 encoder to 
conform with timing and/or other aspects of one particular programme within the 
multiplex carried by a particular MPEG-2 transport stream signal. 

This capability is potentially useful in all multi-programme applications of MPEG-2 
- for example - where MPEG-2 encoders and decoders are cascaded; where 
individual MPEG-2 programmes are to be added, substituted or otherwise combined 
together, or where a non-MPEG-2 programme is to be added, substituted or othenA/ise 
combined with programmes within an MPEG-2 transport stream. 

For example, if one programme is to be substituted for another within a multi- 
programme MPEG-2 transport stream which has already been encoded (i.e. it is from 
"upstream" of the switch system) whilst it is "on-air", MPEG-2 decoders "downstream" 
of the switch system are very likely to produce noticeable artefacts unless the following 
critical timing-related MPEG-2 parameters are consistent before and after the switch: 

• Access Unit (AU) timing, 

• Programme Clock References (PCRs), 

• Decode Time-Stamps (DTSs), 

• Presentation Time-Stamps (PTSs), and 

• Video Buffering Verifier delay ("vbv_delay"). 

An MPEG-2 encoder can make these critical parameters consistent with 
another MPEG-2 programme from "upstream" if that MPEG-2 encoder has a 
"reference" MPEG-2 bit-stream input. 

As a second example, it may be beneficial to make the Elementary Stream (ES) 
bit-rates within a programme being encoded dependent on the bit-rates of one or more 
other programmes from "upstream". Applications which would benefit from this include 
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various forms of statistical multiplexing and the substitution of one programme for 
another within a multi-programme MPEG-2 transport stream, without the use of a full 
(scheduling) MPEG-2 remultiplexer and even where the multi-programme MPEG-2 
transport stream has a fully-occupied payload capacity. An MPEG-2 encoder can 
5 make the ES bit-rates consistent with another MPEG-2 programme if it has a 
"reference" MPEG-2 bit-stream input. 

The only external "references" on conventional MPEG-2 encoders are external 
clock signals from which ES bit-rates and/or total programme bit-rate can be derived. 
This allows bit-rates to be set with high accuracy, which would allow one MPEG-2 
4 0 encoder to have bit-rates very close to those of another MPEG-2 encoder. 
5 The "reference" MPEG-2 bit-stream input according to one aspect of this invention 
S allows bit-rates to be matched exactiv with those from "upstream" encoders. It also 
!i{ allows other MPEG-2 parameters to be matched. It is the exactness of the matching 
5 and the ability to match other parameters (such as PCR's) that make this aspect of the 
=15 invention so powerful. 

=p The nature of the compression unit will depend upon the circumstances. If, for 

m example, a regional opt-out is required, the compression unit will be a full encoder 
n receiving the regional programming as live video. If, in another example, locally- 
targeted advertisements or announcements are to be inserted, these may exist on a 
20 server as pre-encoded streams. The compression unit will in that instance be a 
transcoder. 

Conventional statistical multiplexing employs control paths extending from the 
multiplexer to the individual coders, allocating available bit rate to the respective coders 
whilst ensuring that the fixed bit rate for the multiplex is not exceeded. 
25 This invention provides an alternative an-angement which has certain important 

advantages. 

Accordingly, the present invention consists in another aspect in apparatus for 
forming a multi-programme transport stream having a fixed overall bit rate and in which 
the instantaneous allocation of that bit rate amongst the programme transport streams 
30 is controllable, comprising a plurality of programme compression units each having a 
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reference input; a controller which generates a transport stream reference having sets 
of reference packets associated respectively with the respective compression units, in 
which the relative occurrence of packets of the respective sets reflects the desired 
instantaneous allocation of that bit rate amongst the programme transport streams, 
5 each compression unit receiving the transport stream reference and being arranged to 
output packets in alignment with the reference packets associated with that 
compression unit and a multiplexer which combines the outputs of the respective 
programme compression units to from a multi-programme transport stream. 

The reference transport stream which is passed to all compression units can' 
10 usefully be regarded as a protocol for controlling a statistical multiplexing operation, 
y The outputs of the compression units (which can be encoders or transcoders or a mix 
5 of these) can then be passed to a conventional but non-statistical multiplexer. This will 
01 be convenient if - for example - encryption is required to be added in the multiplexer. 

In simpler arrangements, because the outputs of the respective compression units are 
'^5 aligned with different sets of reference packets and are thus never coincident, it will be 
O possible to combine the streams by a simple OR'ing operation. 
O The invention will now be described by way of example with reference to the 

h accompanying drawings, in which: 

Figure 1 is a block diagram illustrating one embodiment of the present invention 
20 for performing a local opt-out; 

Figures 2 and 3 are block diagrams illustrating processes conducted in the coder 
of Figure 1 ; 

Figure 4 is a block diagram illustrating a further embodiment of the present 
invention for performing a local opt-out; 
25 Figures 5, 6 and 7 are block diagrams illustrating processes conducted in the 

circuitry of Figure 4; and 

Figure 8 is a block diagram Illustrating a further embodiment of this invention for 
multiplexing. 

Before describing in detail specific embodiments of the present invention, it will 
30 be helpful to mention briefly a related technology which is particularly useful in 
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combination with the present invention. 

It is now recognised that problems associated with cascaded encoding and 
decoding processes can be very much reduced (if not eliminated) if a downstream 
encoder has available to it certain of the coding decisions employed by the upstream 
encoder. These decisions may be carried in an information bus which typically 
extends from an MPEG-2 decoder to an MPEG-2 encoder. The information bus can 
with great advantage be carried within the video signal itself. For a more detailed 

explanation, reference is directed to EP 0 765 576 and EP 0 913 058. 

Referring now to Figure 1 , there is illustrated apparatus for performing a local 

programme opt-out. Here, one programme (the "local" programme) is substituted for 

another (the "original" programme) within a multi-programme MPEG-2 transport stream 

broadcast. 

The incoming multi-programme transport stream is received at terminal 102, 
passing through an MPEG delay 104 to a remultiplexer 106. This provides a multi- 
programme transport stream output at terminal 108. Where no local opt-out is in force, 
the input multi-programme transport stream (MPTS) passes seamlessly to the output 
16, subject only to a delay. 

A source of local programming is shown at 1 10 and this provides the input to a 
compression encoder 112. It will be understood that if the compression encoder 112 
were of conventional form, any attempt in the remultiplexer to substitute the locally 
encoded programme for one of the programmes in the MPTS, would almost certainly 
produce severe artefacts, if not crashing, in downstream decoders. 

According to the present invention, the encoder 112 received as a reference 
input the multi-programme transport stream. This reference input is used - in ways 
that will be described - to control the encoder 1 12 so that its output can be substituted 
seamlessly for a designated programme in the MPTS. 

Reference is now directed to Figure 2 which illustrates one of the processes 
Inside the encoder 112 utilising the reference transport stream input. Thus a packet 
detector 200 receives the reference transport stream input together with an indication 
of which programme in the multi-programme transport stream, is to be replaced and 
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which the packet detector is therefore required to tracl<. The packet detector 200 then 
provides for each of the elementary streams of the tracked programme, an indication 
of the location of the associated packets in the MPTS. 

The encoder 112 includes a video coder 202, an audio coder 204 and a data 
coder 206. These coders receive video, audio and data inputs, respectively. The 
encoder further includes a PSl generator 208. 

The video elementary stream will be taken as an example; it will be apparent that 
the remaining elementary streams are treated in analogous fashion. 

The video coder 202 is arranged to provide a packet output when it receives a 
packet request. The corresponding output from the packet detector 200 will normally 
provide such requests so that the video coder 202 will provide packets which are 
aligned with those packets in the reference transport stream which correspond with the 
video elementary stream of the tracked programme. To enable the encoder to function 
in the absence of a reference transport stream input, a stand-alone packet request 
generator 210 is provided. This has a clock-timing reference input and a further input 
which sets the desired bit-rates for the various elementary streams. The packet 
request generator provides an output for each of the elementary streams and there is a 
notional ganged switch arrangement 212 which enables the elementary stream coders 
to be locked either to the incoming reference transport stream or to free run in a stand- 
alone mode under control of the stand-alone packet request generator. 

It will thus be seen that "reference" packets in the MPTS (that is to say the 
packets associated with the elementary stream which is to be replaced by the output of 
a specific coder) are provided to the coder to ensure that the packets which are output 
by the coder are in alignment with those reference packets. In the normal case, this 
will be a temporal alignment although it will be understood that in certain non-real time 
processes, the alignment will be according to a measure which is related to time. The 
reference packets are used additionally to control certain parameters in those packets 
which are output in alignment with the reference packets. 

Referring to Figure 3, the reference packets which are provided by the packet 
detector 200 are passed also to a packet analyser 302. Whilst the packet detector 200 
will provide a reference packet output for each of the elementary streams within the 
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tracked programme, Figure 3 - for clarity of illustration - shows only the video 
elementary stream. 

The packet analyser 302 reads each packet, identifies a number of parameters 
and makes those parameters available to the video coder 202. The packets which are 
output by the video coder are then not only in alignment with the reference packets but 
also share certain key parameters. For example, the packet analyser will identify the 
Programme Clock Reference (PGR) in each packet and will provide this to the video 
coder. The analyser 302 will also identify time stamps (both presentation time stamps 
(PTS) and decoder time stamps (DTS) and the video coder 202 will again ensure that 
these time stamps are present also in the locally coded packets. The analyser 302 will 
also determine the Video Buffering Verifier delay (VDV_delay) and will ensure that this 
value, or related information concerning buffer occupancy, is passed to the video coder 
which uses this information to ensure that there are no discontinuities in buffer 
occupancy. Finally, in this example, the packet analyser 302 is adapted to identify 
frame starts; this information is used in the coder to ensure that there is synchronism in 
the frame starts between the programme to be replaced and the locally encoded 
programme. If there is an established protocol that a frame start will occur at a 
predetermined point in a packet, this location information will simply be the location of 
the packet containing the frame start. 

There will now be described a more detailed embodiment according to the 
present invention. This more detailed embodiment utilises the information bus 
technology, referred to earlier, in which inter-alia, a decoder can make available on an 
information bus, information relating to coding decisions taken in the upstream 
encoding process. 

Reference is now directed to Figure 4. A multi-programme transport stream input 
400 is taken to a distribution amplifier 402 which provides the MPTS input through a 
fixed MPEG-2 delay 404 to a remultiplexer 406. This remultiplexer provides a multi- 
programme transport stream output 408 which in the case where there is no local opt- 
out in effect, corresponds to the MPTS input, subject to a fixed delay. The distribution 
amplifier 402 also makes the transport stream available to a decoder 410. This is 
arranged to decode the particular programme in the multi-programme transport stream 
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which it is required to replace. Decoding of the programme to be replaced is useful in 
that it enables fades or other digital effects to be provided at the splice points, rather 
than a simple switch from one programme into the next. Thus, the decoded video and 
audio from the decoder 410 are passed to a video and audio mixer 412 which also 
receives the output of the local video and audio source 414. Sync signals are taken 
from the decoder 410 to ensure synchronisation of the local video and audio 

source 414. 

The output from the video and audio mixer 412 passes to the coder 416. As with 
the previous embodiment, this ji^coder also receives as a reference input the multi- 
programme transport stream input. Additionally, because the decoder 410 is of the 
type arranged to provide an information bus output, the coder 416 can utilise both the 
transport stream reference input and the information bus to ensure that the packets 
which are output by the coder 416 are capable of seamless remuxing in multiplexer 
406 with the remaining packets of the multi-programme transport stream. 

Transport packets are too frequent to be able to convey their timing in the 
information bus. so the "reference" MPEG-2 transport stream input is used for this 
purpose, in the manner previously described. 

Other co-alignment issues for the "local programme opt-out" application are 
described below. These also illustrate the practical use of the "reference" MPEG-2 bit- 
stream input to the local coder 416 in Figure 4. 

Even when using the video information bus technology to extract coding 
decisions, unavoidable rounding variations in the DCT make it impossible to 
guarantee encoding of an elementary stream to exactly the same number of bits as in 
the "upstream" encoder. An arrangement such as Figure 5. uses control logic within 
the coder 416 employed to align locally encoded access unit (AU) headers with 
corresponding AU headers in the reference transport stream. 

Figure 5 is a generalised outline for a non-specific elementary stream. It shows 
the extraction of AU headers and timestamps (DTSs and PTSs) from the "reference" 
input. To allow the "control logic" block to calculate the relative timing of "local" and 
"reference" AUs, AU headers and timestamps are also extracted from the local video 
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input using a form of the information bus technology which has been extended to carry 
timestamps. 

In more detail, the reference transport stream input is taken to a header detection 
and time stamp extraction block 500 which provides an input to a control logic block 
5 502. The corresponding elementary stream of the local programme is encoded at 
block 504, there being an appropriate control feedback from the control logic block 
502. The output of the encoding process passes to a timestamp (PTS and DTS) 
allocation block 506 and to a main buffer 508. A second header detection and 
timestamp extraction unit 510 operates on the buffer output, to provide the second 
:-40 input to the control logic 502. Real control of the main buffer is effected by the control 
£ logic 502. The output of the main buffer passes through a secondary buffer 512 and 
O through an access unit length adjustment block 514, both of these blocks being under 
% control from the control logic 502. The output of the access unit length adjustment 
5 block 514 is then made available to the remultiplexer 406. 

□5 The "access unit length adjustment" function shown is only needed where a 

E particular ES has AUs of unpredictable length (so that encoded AUs in the "local" 

programme are not guaranteed to be the same length as in the "original" one). This 
M= length adjustment may be performed, for example, by controlling quantisation and by 

inserting ES padding. 

20 The AU co-alignment implementation described above offers a way to 

automatically set the Tine" timing of the "local" data path. This is because after the 
timestamps have been matched up and a local AU header has then arrived before the 
corresponding one from the reference stream, reading from the local video buffer stops 
until an AU header arrives from the reference stream. This has the effect of fine-tuning 

25 the "local path" delay by changing the local main video ES buffer level. 

The AU length adjustment process just described can then be run through once 
after coder power-up to fine-tune the video ES buffer level before attempting any 
seamless switching. 

In addition to the "fine-tuning" just described, the AU co-alignment architecture 
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described above offers a way to set the "coarse" MPEG-2 delay timing during systenn 
installation. This is done in a special set-up mode ("delay coarse adjust" mode) in 
which ail co-alignment is inhibited. Timestamps are extracted in blocks 500 and 510 in 
Figure 5 and sent via the "local CPU" 516 to the overall system controller. This can 
5 then subtract the timestamps and set the "MPEG-2 delay" accordingly. This time 

difference extracted from the timestamps sets the MPEG-2 delay tap which feeds the 
coder. The MPEG-2 delay tap which feeds the Seamless Remux can then be set to 
the same value plus a fixed offset for the remaining path delay difference between the 
two Seamless Remux inputs in Figure 5. 

10 The ability to automate system data path delay set-up in this way shows a 

y benefit of using the information bus and the "reference" MPEG-2 input together at the 

03 MPEG-2 encoder. 

^3 When a switch between bypass and local paths is about to take place, the 

H: encoded data within every ES representing the same uncompressed content must be 

= 1 5 in the same AU in the "local" encoded programme as it is in the "original" one. 

hF For video, co-aligning content requires the arrangement already shown in 

S Figure 5. This shows control logic within the local coder time-aligning locally-encoded 
!=f AUs with corresponding AUs in the "reference" transport stream. This gives complete 
content co-alignment for the video by using its inherent picture boundaries. 

20 Similar methods may be used to co-align audio and data sen/ices. 

When a switch between bypass and local paths is about to take place, the 
decoder buffer levels (in decoders downstream of the whole local opt-out system) must 
be the same for each ES between the "local" programme and the "original" one. This 
constrains the PTSs and DTSs within each local ES. 

25 To meet this constraint, the local coder needs an intemal "local" PGR which is 

consistent with the values passed through the information bus when they are present, 
and which continues to run, locked to the rate of the "reference" bit-stream PGR, when 
values passed through the information bus are absent (i.e. whilst the system is "opted 
out" to the local programme). This "local" PGR can then be used for to generate both 



wo 00/22830 




PCT/GB99/03361 



audio and video timestamps. One possible architecture is shown in Figure 6. 

Although the ES encoding chain is separate for each ES. the local PGR offset 
is set using the video ES only. This is because only one ES needs to be used to 
correct the PGR as all ESs must share the sanr»e common resulting PGR. Gomparing 
5 timestamps within all ESs would also complicate the logic. Video is chosen as the ES 
on which to perform timestamp comparison because it has the best-defined timing 
(using the Video MOLE™). 

Turning to Figure 6, the reference transport stream input is taken to a PGR 
extraction and reconstruction block 602, the output of which is added at 604 with 
JO the output Qf a latch 606. The output of the add block 604 provides a PGR bus 
C which is made available to the audio elementary streams which take their PGR 
□ timing from the video stream. Briefly, for each audio elementary an input 608 is 
% encoded at 610 and passes through a PTS and DTS allocation block 612 which 
P receives the PGR bus. The output of block 612 passes through an elementary 
ri5 stream main buffer 614 to the multiplexer 406. The PGR bus is also latched at 

616 in the processing for the video elementary stream. The input at 61 8 passes 
O to an encode block 504 with extracted information bus, information passing to a 
n PTS and DTS extraction unit 620. This provides an output which is interpolated 
for every picture at 622. The interpolated output passes to a multiplexer 623 
20 which will select the values from the information bus, if these are valid, and pass 
them to the PTS and DTS insertion unit 506. This multiplexer also receives an 
input from the latch 61 6. The output of the interpolation block 622 also passes to 
a subtracter block 624, for subtraction of the values from the latch 616, with the 
output being smoothed at 626 and passing as a PGR offset to latch 606. This 
25 latch receives clock and reset signals from the local GPU 517. 

The timestamps values for each picture may be a PTS, a PTS and DTS, or 
neither. If both are present then only DTSs are subtracted (in the subtract block 624 in 
Figure 6) because there is no need to subtract PTSs as well (the difference between 
PTSs should be the same as between DTSs; the choice of DTSs over PTSs here is 
30 arbitrary). 
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In order for the proposed system architecture to work properly, it must be 
possible to subtract video timestamps for any picture, even though PTSs and DTSs 
may arrive at different times in the "local" and "original" programmes. The local coder 
always produces timestamps for every picture (within the header of the PES packet 
5 which it always produces for every picture). Just in case the "upstream" encoder does 
not. the arrangement of Figure 6 interpolates timestamps for every picture from those 
supplied to the local coder in the information bus from the decoder 410. 

PGR and "vbv_delay" values need to be co-aligned to prevent timing "hiccups" 
in downstream decoders when the local opt-out system performs a seamless switch. 

y 0 In standalone operation the local coder produces valid "vbv_delay" values 

M (which are only ever present within the video ES), and the timestamp co-alignment 
m implementation described above co-aligns the PGR values used internally to the local 
^ coder. However, the "vbv_delay" and PGR values output by the local coder would still 
yCf be incorrect for the following two reasons. 

M5 • The AU co-alignment scheme shown in Figure 5 introduces an ES delay 

□ in the "secondary buffer". This "padding delay" acts is in addition to the main ES 

^ buffer delay which would apply in stand-alone operation. The "padding delay" is 

needed as "local path" delay fine-tuning but it invalidates the "vbv_delay" values 
which pass through it. This is because the main video ES buffer, including the 
20 "padding delay", is a single buffer whose occupancy is used to calculate the local 
"vbv__delay" values. 

• The arrangement of Figure 5 also adds a variable delay by holding up 
local AU headers during AU length adjustment, which invalidates the PGR values 
which pass through it by adding large amounts of jitter. 

25 To correct for these effects, "vbv_delay" and PGR values can be re-calculated 

from scratch just before the output of the MPC. Figure 7 shows one possible 
implementation of this "re-stamping". 

The reference transport stream input is taken to block 702 where the PGR is 
extracted and a full PGR at 27 MHz resolution is reconstructed. This reconstructed 
30 PGR then passes through block 704 where a fixed offset is added for the delay from 
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the reference input to the local output. The full PGR is reduced in block 706 to a non- 
extended format (90 kHz resolution). In block 708 a variable offset is added to 
compensate for the padding delay added to the main video elementary stream buffer in 
alignment of the packet. This provides a PGR bus which is used as shown generally in 
5 block 710 for the elementary stream encoders, buffer, timestamp and (optionally) PGR 
insertion. Timestamps are extracted at 712 and in block 714 the PGR value from 
block 706 is subtracted to provide an output in block 71 8. This receives the output of 
the access unit co-alignment block 716 and re-stamps, that is to say locates and 
replaces the VBV_deiay. The output passes to block 720 which receives inputs from 
10 the block 704 and the local GPU 517 to re-stamp (that is to say locate and replace) 

□ PGR. The output of block 720 then forms the local path output. 

The "variable offset" to the PGR bus shown in Figure 7 is the same "offset" as is 
01 shown in Figure 6. The "timestamp extraction" block shown in Figure 7 is the same one 
J, used to identify each "local" video AU for AU co-alignment (the lower of the two shaded 
iM5 blocks in Figure 5). The timestamp extracted from the video ES is the DTS value (or 
O the PTS if there is no DTS) because "vbv_delay" is a time interval before decoding 
5 rather than before presentation. 

□ Each of the preceding co-alignment mechanisms is dependent on extracting 
timing-related information from the "reference" input to the local coder within the local 

20 opt-out system. Go-alignment of each parameter is vital to guarantee that the "local 
opt-out" can be seamlessly switched in and out, i.e. without artefacts at "downstream" 
decoders. 

In addition, the "reference" input has been shown to allow automatic system 
data path delay equalisation when used in conjunction with the information bus 
25 technology. 

In the preceding examples, attention has been focussed on the situation in 
which it is desired to replace one programme in a multi-programme transport 
stream. This is not the only use, however, of a reference transport stream input 
according to the present invention. There are situations, for example, in which it will 
30 be useful to use a single transport stream reference input to control a compression 
unit, either an encoder or a transcoder. In a more radical departure, it will be useful 
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in certain cases to employ a reference transport stream input which is not taken 
from a "real" multi-programme transport stream, but is artificially generated, purely 
as a reference. An example will make this clearer. 

It is a common requirement to multiplex a number of single programme 
5 transport streams with dynamic allocations of bitstreams according to the content or 
priority of the respective single programme transport streams. So-called statistical 
multiplexers are available which have elaborate control links with the single 
programme transport stream encoders to enable the required dynamic allocation of 
bit-rates. In certain circumstances, a programme encoder will be remote from the 
10 multiplexer with no control loop being feasible. The single programme transport 
o stream may, for example, exist in encoded form on a file sen/er. In such a case, it 

will be preferable to pass the encoded transport stream through a transcoder rather 
7} than to decode the transport stream to video in one unit and then to pass the video 

Ji signal to a coder unit which js capable of receiving a control signal from the 

7h 5 multiplexer. There will be other situations where the requirement to receive a 
2 specific format of control signal from a statistical multiplexer will represent an 

□ undesirable constraint. 

□ Turning now to Figure 8, there is shown an arrangement in which a series of 
transcoders 801 to 810, each receives a single programme transport stream from a 

20 file server 820. The single programme transport streams from the transcoders are 
multiplexed at 830 to form a multi-programme transport stream. 

A reference transport stream generator 840 generates what might be termed a 
template for the multi-programme transport stream output of the multiplexer 830. 
Within this reference multi-programme transport stream, reference packets will be 

25 allocated to the specific programmes and the number of packets allocated per unit 
time to a specific programme will effectively set the instantaneous bit-rate output for 
the transcoder for that programme. Since the transcoders which supply the 
multiplexer 830 are all constrained to provide packets in alignment with the 
reference transport stream, it is ensured that the overall desired bit-rate for the multi- 

30 programme transport stream output (whether fixed or variable) is always complied 
with. Moreover, since the nature of this control does not rely on feedback loops 
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from the multiplexer to a coder, there is no requirement to allow a safety margin in 
the bit-rate allocation to account for control delays and tolerances. This will ensure 
optimal use of the available output bit-rate. The use of a transport stream reference 
has a further advantage that a well-documented and easily reproducible control 
5 input is employed, rather than a proprietary control loop. 

Each transcoder will typically comprise a decoder and an encoder linked using 
information bus technology so as to avoid cascade loss. The encoder stage will 
then employ the reference transport stream input and the information bus signal in a 
manner analogous to that previously described so as to provide a single programme 
10 transport stream output which has packets aligned with the nominated packet of the 
^ reference transport stream input. Moreover, the individual packets of the single 

ffl programme transport stream will taken parameters (such as the PGR and 

m timestamps) from the nominated packets of the reference transport stream input. 

En The reference transport stream generator 840 may receive information 

^"15 concerning the SPTS's from the file servers or from the transcoders. It will typically 

y also receive external control signals. 

One particular example of use of the arrangement of Figure 8 where control of 
□ the reference transport system generator 840 is especially straightforward is for 

Near Video on Demand (NVOD). Here the various single programme transport 
20 streams are time-shifted version of each other. 

It will be understood that this invention has been devised by way of examples 
only and a wide variety of further modifications are possible within objects from the 
scope of the invention. 



